Visual Human Face Tracking and its Application to Lip-Reading and Emotion Recognition
نویسنده
چکیده
We describe a visual face tracking algorithm which tracks the global as well as the nonrigid face movement in three dimensions using one camera. It is based on 3D face models. Using the face movement constraints, it is possible to track robustly and in real time. The results of the face tracking have been used in a number of applications including lip reading and emotion recogntion. In both cases, fusing the visual cues with audio speech analysis improves the performance significantly. 17 Proc. VIIth Digital Image Computing: Techniques and Applications, Sun C., Talbot H., Ourselin S. and Adriaansen T. (Eds.), 10-12 Dec. 2003, Sydney
منابع مشابه
Automatic Lip Contour Tracking and Visual Character Recognition for Computerized Lip Reading
Computerized lip reading has been one of the most actively researched areas of computer vision in recent past because of its crime fighting potential and invariance to acoustic environment. However, several factors like fast speech, bad pronunciation, poor illumination, movement of face, moustaches and beards make lip reading difficult. In present work, we propose a solution for automatic lip c...
متن کاملLip Tracking Towards an Automatic Lip Reading Approach
Current era is to make the interaction between humans and their artificial partners (Computers) and make communication easier and more reliable. One of the actual tasks is the use of vocal interaction. Speech recognition may be improved by visual information of human face. In literature, the lip shape and its movement are referred to as lip reading. Lip reading computing plays a vital role in a...
متن کاملEmotion recognition and estimation from tracked lip features
We transmit and display information through the visual image of our lips; information about our speech and our emotions and expressions. By tracking the movement of the lips, computers can make use of the visual part of the information. We focus on how to make use of tracked lip features for emotions. We have found that people are better at interpreting basic emotions displayed through an anima...
متن کاملDesigning and implementing a system for Automatic recognition of Persian letters by Lip-reading using image processing methods
For many years, speech has been the most natural and efficient means of information exchange for human beings. With the advancement of technology and the prevalence of computer usage, the design and production of speech recognition systems have been considered by researchers. Among this, lip-reading techniques encountered with many challenges for speech recognition, that one of the challenges b...
متن کامل3d Lip-tracking for Audio-visual Speech Recognition in Real Applications
In this paper, we present a solution to the problem of tracking 3D information about the shape of lips from 2D picture of a speaker. We focus on lip-tracking of audio-visual speech recordings from the Czech in-vehicle audio-visual speech corpus (CIVAVC). The corpus consists of 4 h 40 min records of audiovisual speech of driver recorded in a car during driving in an usual traffic. In real condit...
متن کامل